SCIENTIFIC 

REPORTS 




OPEN 



SUBJECT AREAS: 
NETWORK TOPOLOGY 
COMPUTATIONAL SCIENCE 

Received 
7 August 2013 

Accepted 

23 June 2014 

Published 

24 July 2014 



Correspondence and 
requests for materials 
should be addressed to 
H.-T.Z. (zht@mail.hust. 
edu.cn) or T.Z. 
(zhutouster@gmail. 



Route-dependent switch between 
hierarchical and egalitarian strategies in 
pigeon flocks 

Hai-Tao Zhang 1 , Zhiyong Chen 2 , Tamas Vicsek 3 , Guanjun Feng 1 , Longsheng Sun 1 , Riqi Su 4 &Tao Zhou 5 

1 School of Automation, Key Laboratory of Image Processing and Intelligent Control, State Key Laboratory of Digital Manufacturing 
Equipments and Technology, Huazhong University of Science and Technology, Wuhan 430074, P.R. China, 2 School of Electrical 
Engineering and Computer Science, The University of Newcastle, Callaghan, NSW 2308, Australia, 3 Department of Biological 
Physics, Eotvos University, Pazmany Peter setany 1A, H-l 1 17, Budapest, Hungary, 4 Department of Modern Physics, University of 
Science and Technology of China, Hefei 230026, PR China, 5 Web Sciences Center, University of Electronics Science and 
Technology of China, Chengdu 61 0054, P.R. China. 

The mechanisms that underlie fascinating inter-individual interactions among animal groups have 
attracted increasing attention from biologists, physicists, and system scientists. There are two well-known 
types of interaction patterns: hierarchical and egalitarian. In the former type, individuals follow their 
leaders, whereas they follow their neighbors in the latter. Using high-resolution spatiotemporal data derived 
from the free flights of a flock of pigeons, we show that pigeon flocks actually adopt a mode that switches 
between the two aforementioned strategies. To determine its flight direction, each pigeon tends to follow the 
average of its neighbors while moving along a smooth trajectory, whereas it switches to follow its leaders 
when sudden turns or zigzags occur. By contrast, when deciding how fast to fly, each pigeon synthesizes the 
average velocity of its neighbors. This switching mechanism is promising for possible industrial applications 
in multi-robot system coordination, unmanned vehicle formation control, and other areas. 

Over the last decade, scientists have been investigating common, possibly universal, features of the 
collective behaviors of animals, bacteria, cells, molecular motors, and driven granular matter 1 . 
Biological social organisms form striking aggregation patterns, displaying cohesion, polarization, and 
collective intelligence 2 . The most interesting characteristic of biological groups, such as bird flocks 3,4 , fish 
schools 7-9 , insect swarms 10 , bacterial colonies 11 , and metastasizing cancer cells 12 , is the emergence of ordered 
states where the agents move in the same direction 1318 . The pursuit for an ordered state is also the focus of many 
closely related problems, such as consensus 19 , rendezvous 20 , synchronization 21 , and cooperation 22 . This type of 
distributed collective system has direct implications for sensor network data fusion 23 , load balancing 24 , unmanned 
air vehicles 20 , attitude alignment of satellite clusters 25 , multi- robot formation control 26 , human population beha- 
vior evolution analysis 27 , evacuation strategies for emergency escapes during panics 28 , etc. 

Among the numerous examples of collective biological movement, many studies have attempted to understand 
the flocking of birds. For example, wild geese try to synchronize their velocities during migration to keep the 
rigidity of the V-shaped formation 29 , which can save the kinetic energy for the whole flock. As another paradigm 
of birds' collective phenomena, during landing procedure, it is shown by 30 that birds arrive at a decision resulting 
in their synchronized position and velocity. Cavagna et al. 3 ' obtained high resolution spatial data of thousands of 
starlings and detected a power-law decay in the behavioral correlation. DelFAriccia et a\? 2 found that the homing 
performance of a flock of birds flying was significantly better than that of the birds when they were released 
individually. Extensive studies have identified various features of bird flocks, including the initiation of movement 
and the mode of propagation 33 , anti-predatory positional effects on vigilance 34-35 , flock positional effects and 
intra-specific aggression in European starlings 36 and three-dimensional congregation 37 . 

There are two well-known types of interaction pattern. The first is called the egalitarian pattern, where a 
representative model called the fixed neighborhood region (FNR) model, assumes a ball-shaped eyesight range 
with a fixed radius 13-38 , as shown in Figure la. A recent large-scale study of 2,600 individual starlings suggested 
another egalitarian pattern 3 , where each agent merely interacts with a fixed number of nearest neighbors, instead 
of individuals within a specific distance. This is known as the fixed number of neighbors (FNN) model and it is 
illustrated in Figure lb. The FNN mechanism is supported by a theoretical model 39 as well as empirical observa- 
tions of mosquitofish schools 40 . 
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Figure 1 | Illustrations of the two types of interaction pattern, (a) Egalitarian pattern I: fixed neighboring region (FNR). (b) Egalitarian pattern II: fixed 
number of neighbors (FNN) with n = 3. (c) Hierarchical pattern: hierarchical leadership network (HLN) with three levels. 



In addition to the pairwise leader-follower relationship 7,8 , Nagy 
et al. 4 proposed a hierarchical leadership network (HLN) model 
where each pigeon follows its leaders and is followed by some other 
pigeons, as illustrated in Figure lc. Earlier experiments by Biro et al. 41 
also support the existence of HLN among homing pigeon flocks. 
Very recently, Xu et al. 5,6 improved the HLN model by introducing 
reciprocal relationships and distance-dependent attraction/repul- 
sion interactions. 

These two seemingly contradictory interaction patterns suggest a 
significant question: which pattern determines the real collective 
dynamics of pigeon flocks? In the present study, we extend the pre- 
vious understanding of this system and demonstrate the existence of 
a switching mechanism, i.e., each pigeon synthesizes the velocities of 
its neighbors and adopts the average direction of its neighbors while 
moving along a smooth trajectory, whereas it switches to follow its 
leaders when sudden turns or zigzags occur. 

Results 

Quantitative inter-agent movement relationship analysis. We 

analyzed real GPS data recordings of the three-dimensional 
positions and velocities of 11 free flights by 10 pigeons. The 
trajectories and an HLN topology of a typical experiment (labeled 
as ff5 in Figure 5) are shown in Figures SI and S2, respectively, 
of Supporting Information(SI), and more details of the data and 
experiments are presented in the Methods and Materials. In 
addition to the results presented in Figure 5 and Figure S7 of SI, all 
of the other experimental results were derived from experiment ff5. 
To evaluate the interaction mechanisms that control the collective 
motions of pigeon flocks, we quantified the synchronization intensity 
and rigidity of the overall flock using a direction synchronization 
error index (j> and a velocity synchronization error index respec- 
tively (see Methods and Materials). There are no clear biological 
results to demonstrate that "birds exhibit maximal synchronization," 



but previous studies assume the use of a synchronization intensity 
as an index for collective bird behavior analysis 1,3-6 , thus it was 
also employed in the present investigation. Moreover, we did not 
aim to propose a dynamic model to accurately estimate the overall 
trajectory of the pigeon flock, as shown in Figure SI of SI. Indeed, 
the flock trajectory is too complex to be modeled precisely using 
machining learning methods. Instead, we aimed to extract the 
switching mechanism between two well-accepted inter-agent inter- 
action patterns, i.e., hierarchical and egalitarian patterns, based on 
quantitative data analysis. 

The two indices 0 ( and {j/, are shown in Figures 2a and 2b, respect- 
ively. In the HLN pattern, some pigeons have more than one direct 
leaders and the best matching leader takes the lowest synchroniza- 
tion errors (/> . and \jj ., which is referred as HLN-min. Analogously, the 

average value of the matching errors of all the leaders and i/^ is 
denoted as HLN-avg. As shown in Figure 2a, there is no obvious 
difference between FNR/FNN and HLN-min except for pigeon G, 
where HLN outperforms FNR/FNN. For conciseness, we use the 
abbreviation HLN to denote HLN-min. However, as shown in 
Figure 2b, the advantages of FNR/FNN are significant compared 
with HLN when considering the velocity modulus. The effects of a 
different neighborhood radius r on FNR and a different neighbor- 
hood size n on FNN are respectively shown in Figure S3 of SI, which 
indicate the robustness of the observations. 

Extraction of factors. Figure 3a shows the curvature i] (see Materials 
and Methods for the definition of the curvature) of the trajectories for 
some of the pigeons in Figure SI of SI. We define sudden turns as 
those with a curvature greater than a threshold ;; 0 . Figure 3b shows 
the percentage of sudden turns among all pigeons for ;; 0 = 0.09, 0.10, 
0.11, and 0.12 (1/m) (all points with > 0.09 (1/m) are marked in 
Figure SI). Pigeon G always exhibited more sudden turns or zigzags 
than the other pigeons, except the two leaders A and M. Thus, we 
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Figure 2 | The direction synchronization error ^/a) an d velocity 
synchronization error j#j (b) for pigeons B to L. In (a), there is no clear 
difference between HLN-min and FNR/FNN except for pigeon G, in which 
case HLN-min evidently outperforms FNN/FNR. However, this is not the 
case in (b). Instead, the advantages of FNR/FNN compared with HLN are 
quite significant when considering the velocity modulus. In this case, the 
indices 0 ; and are the average values of <^,(f) and ^(f) for the entire 

1 f r 

temporal evolution period, respectively, such as fj = — <l>t(t)dt and 
1 



\l/j(t)dt with T = 120s. The error bars indicate the standard 



deviations during the temporal evolution period. Note that pigeons A and 
M act as the highest and the second highest leaders of HLN, thus their 
movements are generally not influenced by those of others. Therefore, they 
have not been taken into consideration. 



suggest that when facing sudden turns, a pigeon may not have 
sufficient time to synthesize its direction with its neighbors, so it 
will follow its direct leaders instead. This is why HLN outperforms 
FNR7FNN for pigeon G. By contrast, a pigeon tends to adopt the 
average direction of its neighbors when moving along a smooth 
trajectory. However, each pigeon should consider the velocities of its 
neighbors to determine its flight speed, otherwise it will be too far in 
front or lag behind the rest of the flock. Figure 2b suggests that FNR/ 
FNN performs better in maintaining the rigidity of pigeon flocks. 
Figure 4 shows the change in the average direction modeling error, 

(j> — - ^2 e j£ c d g h 1 1 L] ^i' tmle - Sometimes the HLN exhibits 
significant advantages in modeling precision (i.e., lower synchron- 
ization errors). We compare HLN-dominating segments 
with the temporal evolutions of the average curvature, 

E, w,, for all eight followers. Indeed, there 
jelB,C,D,G,H,IJ,L} 'J ° 



1 

are 37 local minima of the HLN curve and 22 local maxima of 
the //-curve, where 12 segments agree well, which are defined as 

t' HLN — t < 6 with threshold 8 = OAs and i is the sequential num- 



ber of the matching segments. Thereby, it is implied that pigeons 
tend to follow the directions of their leaders instead of their neigh- 
bors when experiencing sudden turns. To test the generality of this 
observation, Figure S4 of SI also shows the temporal curvature evo- 
lutions tf A , r) M , r\ G , r\ D of the two leaders A, M and the two followers G 
and D at different hierarchical levels. Again, some HLN-dominating 
segments match the peaks of the four curvature curves well, thereby 
supporting our conclusion. 

With respect to the temporal evolution of the velocity error index 
\jj (see Figure S5 of SI), there is no clear correlation between the HIN- 
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Figure 3 | (a) Curvatures of the trajectories of pigeons A, M, D, H, G. A and 
M are leaders, thus they have sharper curvatures than those of D, H, G. 
Moreover, it can be seen that pigeon G generally has a larger curvature than 
D and H, thereby indicating that it experienced more sudden turns. 
Without any loss of generality, we select pigeons D and H because they are 
followers in different levels. More precisely, D is lower than G and H is 
lower than D, as shown in Figure S2 of SI. (b) Percentages of the sudden 
turn points larger than r\ 0 for different pigeons. The aforementioned 
observation is supported by (b) because the sudden turns percentage is 
significantly higher for G than those for D and H, which also helps to 
explain why HLN outperforms FNR/FNN only for pigeon G. 

dominating segments and the peaks of the curvature curve. By con- 
trast, FNN/FNR generally has lower synchronization errors, which 
shows that the egalitarian pattern can describe the change in velocity 
better. We also show the temporal evolution of the modeling errors <j> 
and \\i with different parameters for FNR/FNN patterns in Figure S6 
of SI. Moderate changes in the parameters do not affect the main 
results. 

Figure 5 shows the probability density functions for the HLN- 
dominating and FNR- dominating cases, respectively. The dotted 
curve (i.e., the highest curve) in Figure 5a is the curvature distri- 
bution. Given a curvature (e.g., r\ = 0.05 (1/m)), a probability of 
1.8% indicates that 1.8% of the data points have a curvature of 
0.05. If 60% of these data points with r\ = 0.05, HLN performs better 
than FNR, whereas the reverse is true for the other 40%. Thus, the 
HLN-dominating probability is 1.08% and the FNR- dominating 
probability is 0.72%. Note that due to the discretization resolution 
of 11, in our numerical analysis, ;/ = 0.05 means that r\ 6 (0.05 — er, 
0.05 + c] with a resolution of a = 0.005. The peaks of the HLN- 
dominating and FNR- dominating density functions are emphasized 
by a solid vertical line and a dashed vertical line, respectively. These 
two values are the typical dominating curvatures for HLN and FNR, 
respectively. Figure 5 shows two statistical features: (i) the typical 
dominating curvature of HLN is larger than that of FNR; (ii) FNR 
typically works better for small-curvature cases whereas HLN per- 
forms better for large-curvature cases. These two features are also 
verified by the frequency maps for all 1 1 free flights, which are shown 
in Figure S7 of SI. Moreover, Figure 5 shows that HLN dominates 
some time instants, but also some time segments that correspond to 
large trajectory curvatures, which are highlighted by diamonds in 
Figure SI of SI. 
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Figure 4 | Temporal evolution of the average direction modeling errors (/> with FNR/FNN and HLN patterns. Clearly, some HLN-dominating temporal 
segments match the local maxima of the average curvature curve r\* quite well. This figure suggests that pigeons tend to follow the directions of their 
leaders, rather than their neighbors, when experiencing sudden turns. 



Theoretical model. We use a theoretical flocking model with a leader 
A and m followers F\ , ■ • ■ ,F m to further verify our results. Initially, as 
shown in Figure 6a, their positions p, = [Xi,yi] T , {i = A,F\, ■ ■ ■ ,F m ) are 
distributed evenly as y- t — 1, \x^ — xp t \ = \xp, — xp 2 \ — ■ ■ ■ = \xp ml — 
xp m | = d, and their initial movement directions are all upward as 0, = 
nil. The leader A moves along some predetermined ellipsoidal 
trajectories with decreasing curvatures at the upper peaks, and the 
angular velocity of A, to, is a constant that is not influenced by others. 
All of the followers adopt either FNR or HLN rules, and they move in 
an L X L square with a periodical boundary condition. According to 
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Figure 5 | (a) Probability density function showing the dominating 
probabilities of HLN and FNR. The peaks of the HLN and FNR curves are 
at t] = 0.022 (1/m) (vertical dashed line) and 0.033 (1/m) (vertical solid 
line), respectively. These two peaks are the typical dominating curvatures 
of HLN and FNR. (b) The typical dominating curvatures of HLN and FNR 
in the 1 1 free flight datasets. The typical dominating curvatures of HLN are 
all much higher than those of FNR. 



the FNR rules, each follower's movement direction is determined by 
the average direction of the instantaneous neighbors in a sphere with 
a radius r that has this follower at its center, and its speed is set to the 
same as that of A so all individuals have the same speed at the same 
time. This type of alignment mechanism represents the interaction 
process of FNR well, and FNN operates in a similar manner. For 
HLN, we arrange the individuals in a sequence as A,F\, ■ ■ ■ ,F m and 
set an interaction topology as A— >F t -> ■ ■ ■ — >F m , where the former is 
the direct leader of the latter. To focus on the sequential nature of 
the hierarchical effects, we ignore the movement direction mis- 
matches between each leader-follower pair. Thus, with a time delay 
t, the movement directions are iterated as Qp 1 ( t) = ( t — z) , 0p 2 ( t) = 

d Fl (t-z),---,d Pm (t)=dp m _ 1 (t-T). 

Figures 6b and 6c show that, depending on the synchronization 
index ] a (see Materials and Methods, the higher the better), HLN 
outperforms FNR for large curvatures beyond a specified threshold 
y\ c , which is related to the time delay t. In brief, the theoretical 
model again supports our conclusion that HLN is more likely to be 
adopted upon sudden turns, whereas FNR/FNN is applied in smooth 
conditions. 

Discussion 

Inter-individual interactions in collective biological groups are con- 
sidered to involve two well-known mechanisms: following leaders or 
following neighbors. In the former mechanism, leadership can be 
hierarchical 4 or mono-level 12,27 , whereas the neighbor-hood can be 
defined by geometry 1338 or topology 3 in the latter. The controversy 
between the leadership-dominating and egalitarian strategies has 
lasted for years, and it can be further generalized to monarchical 
and democratic ruling systems in socialized animal groups 42 . In the 
present study, we propose a more sophisticated system where 
pigeons switch between the two aforementioned strategies to facil- 
itate the fine regulation of their movements in a variable envir- 
onment. Each pigeon employs a hybrid strategy when deciding the 
direction of movement: it follows the leaders during sudden turns but 
synthesizes its neighbors movements when the trajectory is smooth. 
To determine its speed of flight, each pigeon also synthesizes its 
instantaneous neighbors to avoid potential lagging. To some extent, 
this is similar to how group decisions are made in other animal 
groups 43 . In addition, a pigeon flock is a sophisticated self- organized 
system, which could inspire the design of multi-agent systems. For 
example, the switchable hybrid strategy may improve the perform- 
ance of multi-robot system coordination, particularly by reducing 
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Figure 6 | (a) Illustration of the theoretical model where the leader A moves along smoother trajectories as the sizes of the ellipsoids increase. The 
hierarchical leadership network is A-*F t -> • • ■ ->F m . Moreover, due to the periodical boundary condition, no agent other than the leader A can 
completely escape the influence of others, (b), (c) The synchronization index /„ of HLN and FNR increases with the trajectory curvature rj. The parameters 
were set as: (b) I = 2.2, r = 1.3, m = 2, d = 0.7, and to = 7t/50; (c) I = 2.2, r = 0.9, m = 6,d= 0.4, and co = 7i/200. The initial speed was set to 0.03Land we 
tested different time delays. In this model, FNN is equivalent to FNR, e.g., FNR with r = 0.9 is equal to FNN with n = 4, and FNR with r = 1.3 is equal to 
FNN with n=l. Each point is the average of 200 samples around the ellipse peak. According to the synchronization index /,„ HLN outperforms FNR for 
large curvatures beyond a specified threshold if a as indicated by the vertical lines in (b) and (c). Note that the displacements in (a) do not have a unit, thus 
the curvatures in (b) and (c) also have no unit. 



communication costs because HLN generally requires the transmis- 
sion of much less information compared with FNR/FNN. 

The present study only considers small pigeon flocks, thus these 
results still require further verification using real experimental data 
for other animal groups (e.g., starlings 3-31 , surf scoters 2 , wild geese 29 , 
insect colonies 10 , and fish schools 9 ). Cross-species comparisons will 
determine the universality of the conclusions presented in this 
study, i.e., does this general switching mechanism underlie the 
behavior of many disparate animal flocks or is it only applicable 
to bird flocks (possibly even pigeons)? Another open question that 



requires further investigation is whether this switchable inter- 
action mechanism operates in large-scale pigeon flocks and, if this 
is the case, how pigeons organize a large-scale hierarchical lead- 
ership network and whether the leader-follower relationships 
depend on the actual distance. 

Methods 

Data acquisition and description. Ten pigeons aged 1-5 years were used in the 
experiments conducted by Nagy et al 4 . These experiments were permitted and 
supported by the Hungarian Racing Pigeon Sports Federation 4 . All of the birds had 
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previous homing experience and most had competed previously in races (100 km) for 
young pigeons. The pigeons were normally allowed to fly freely outside the loft twice 
each day. Initially, each pigeon was equipped with a Plasticine dummy weight (16 g, 
i.e., the same size and weight as the GPS logger), which was fixed to their back with an 
elastic harness, so it could become habituated to flying and living with a load. The 
distance between the starting and ending point of the free flight was 14.8 km. The data 
analyzed comprised 1 1 free flights around the home loft. An average flight comprised 
12 min in the air. In total, the GPS devices logged 32 h of flight time with 580,000 data 
points, each of which comprised x-, y-, and z-coordinates based on the flat earth 
model 4 with a temporal resolution of 0.2 s. 

Quantification of movement synchronization. To quantify the direction 
synchronization performance of an arbitrary individual i with FNR/FNN, we define 

the synchronization indices as ^^(f) — |-^-|^^j E £. ^1 — 0 t{t)' 9 j(t)^j and 



^.(f) — min j E Ci — & iff)' $ j(f) J ■ ^ n tms case > * 1S tmie variable, Cj is the set of 
neighbors of / where \d\ is the number of neighbors, the movement angle 
9 : — [cos 6, sin 9] T , and the symbol "." denotes "inner product." Hence, 
1 — 9 ,*' 6 j represents the difference between the direction of individuals i and its 
neighbor j (i.e., smaller is better) . Specifically, 1 — B /* 9 j — 0 and 2 for a completely 
synchronized couple and for a couple with opposite movements, respectively. (j)j and 
(j>. denote the average and minimal values, respectively, of the differences in the 
movement directions between individual i and all its neighbors. 

Analogously, we define the velocity synchronization error indices as 



and ij/ (f) 



||vf(0-"ij(0|| 



the velocity of i is perfectly synchronized with that of its neighbors, then ita — 0. By 
contrast, if the velocities of i and its neighbors are very different, then ita will be a large 
positive number. Similar to the notations of the direction synchronization indices, ij/j 
and \js . denote the average and minimal values, respectively, of the velocity differences 
between individual i and all its neighbors. 

In the same manner, we define the direction and velocity synchronization indices 

of HLN as Ut) = [ J = 

JL V |R(t)- ^(t- 



Clearly, if 



( 1 4W'|((-^)),«()=0E^ 



^(f)-^(t- 



. In this case, Cj denotes all the leaders of i and 



t« is the time delay between individual i and its leader j. 
The average velocity synchronization index is defined as 

J a — J , 11^ MeAr ^ jj[ \Y e use tru S index rather than the order parameter in 13 
a ^ l = 1 nTv 0 (t) V 
because the velocity modulus varies throughout the time evolution. Clearly, J a = 1 
implies complete velocity synchronization, whereas J a — 0 represents a totally dis- 
ordered state. 

Trajectory curvature definition. The sudden turns and smooth points of the moving 
trajectories are differentiated quantitatively based on the curvature 44 : 



MtMt)-*wm\) 



where AT;(f) and y^t) are the x— and y,— axis positions during the temporal evolution of 



pigeon i, respectively, / — 



dt 



and/ — 



dt 2 



- . Clearly, different points along the 



trajectory have different curvatures and a larger curvature indicates a higher 
likelihood that the corresponding point is part of a sudden turn. Note that the unit of 
pigeon displacements is m (meter), thus the curvature unit is 1/m in the present study. 
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